Approaches, applications, and challenges in physiological emotion recognition — a tutorial overview

An automatic emotion recognition system can serve as a fundamental framework for various applications in daily life from monitoring emotional well-being to improving the quality of life through better emotion regulation. Understanding the process of emotion manifestation becomes crucial for building emotion recognition systems. An emotional experience results in changes not only in interpersonal behavior but also in physiological responses. Physiological signals are one of the most reliable means for recognizing emotions since individuals cannot consciously manipulate them for a long duration. These signals can be captured by medical-grade wearable devices, as well as commercial smart watches and smart bands. With the shift in research direction from laboratory to unrestricted daily life, commercial devices have been employed ubiquitously. However, this shift has introduced several challenges, such as low data quality, dependency on subjective self-reports, unlimited movement-related changes, and artifacts in physiological signals. This tutorial provides an overview of practical aspects of emotion recognition, such as experiment design, properties of different physiological modalities, existing datasets, suitable machine learning algorithms for physiological data, and several applications. It aims to provide the necessary psychological and physiological backgrounds through various emotion theories and the physiological manifestation of emotions, thereby laying a foundation for emotion recognition. Finally, the tutorial discusses open research directions and possible solutions

How to Relax in Stressful Situations: A Smart Stress Reduction System

Stress is an inescapable element of the modern age. Instances of untreated stress may lead to a reduction in the individual's health, well-being and socio-economic situation. Stress management application development for wearable smart devices is a growing market. The use of wearable smart devices and biofeedback for individualized real-life stress reduction interventions has received less attention. By using our unobtrusive automatic stress detection system for use with consumer-grade smart bands, we first detected stress levels. When a high stress level is detected, our system suggests the most appropriate relaxation method by analyzing the physical activity-based contextual information. In more restricted contexts, physical activity is lower and mobile relaxation methods might be more appropriate, whereas in free contexts traditional methods might be useful. We further compared traditional and mobile relaxation methods by using our stress level detection system during an eight day EU project training event involving 15 early stage researchers (mean age 28; gender 9 Male, 6 Female). Participants' daily stress levels were monitored and a range of traditional and mobile stress management techniques was applied. On day eight, participants were exposed to a 'stressful' event by being required to give an oral presentation. Insights about the success of both traditional and mobile relaxation methods by using the physiological signals and collected self-reports were provided

personal stress level clustering and decision level smoothing to enhance the performance of ambulatory stress detection with smartwatches

n/

CNN-Based Page Segmentation and Object Classification for Counting Population in Ottoman Archival Documentation

Historical document analysis systems gain importance with the increasing efforts in the digitalization of archives. Page segmentation and layout analysis are crucial steps for such systems. Errors in these steps will affect the outcome of handwritten text recognition and Optical Character Recognition (OCR) methods, which increase the importance of the page segmentation and layout analysis. Degradation of documents, digitization errors, and varying layout styles are the issues that complicate the segmentation of historical documents. The properties of Arabic scripts such as connected letters, ligatures, diacritics, and different writing styles make it even more challenging to process Arabic script historical documents. In this study, we developed an automatic system for counting registered individuals and assigning them to populated places by using a CNN-based architecture. To evaluate the performance of our system, we created a labeled dataset of registers obtained from the first wave of population registers of the Ottoman Empire held between the 1840s and 1860s. We achieved promising results for classifying different types of objects and counting the individuals and assigning them to populated places

Automatic Estimation of Age Distributions from the First Ottoman Empire Population Register Series by Using Deep Learning

Recently, an increasing number of studies have applied deep learning algorithms for extracting information from handwritten historical documents. In order to accomplish that, documents must be divided into smaller parts. Page and line segmentation are vital stages in the Handwritten Text Recognition systems; it directly affects the character segmentation stage, which in turn determines the recognition success. In this study, we first applied deep learning-based layout analysis techniques to detect individuals in the first Ottoman population register series collected between the 1840s and the 1860s. Then, we employed horizontal projection profile-based line segmentation to the demographic information of these detected individuals in these registers. We further trained a CNN model to recognize automatically detected ages of individuals and estimated age distributions of people from these historical documents. Extracting age information from these historical registers is significant because it has enormous potential to revolutionize historical demography of around 20 successor states of the Ottoman Empire or countries of today. We achieved approximately 60% digit accuracy for recognizing the numbers in these registers and estimated the age distribution with Root Mean Square Error 23.61

Continuous Stress Detection Using Wearable Sensors in Real Life: Algorithmic Programming Contest Case Study

The negative effects of mental stress on human health has been known for decades. High-level stress must be detected at early stages to prevent these negative effects. After the emergence of wearable devices that could be part of our lives, researchers have started detecting extreme stress of individuals with them during daily routines. Initial experiments were performed in laboratory environments and recently a number of works took a step outside the laboratory environment to the real-life. We developed an automatic stress detection system using physiological signals obtained from unobtrusive smart wearable devices which can be carried during the daily life routines of individuals. This system has modality-specific artifact removal and feature extraction methods for real-life conditions. We further tested our system in a real-life setting with collected physiological data from 21 participants of an algorithmic programming contest for nine days. This event had lectures, contests as well as free time. By using heart activity, skin conductance and accelerometer signals, we successfully discriminated contest stress, relatively higher cognitive load (lecture) and relaxed time activities by using different machine learning methods

Application Level Performance Evaluation of Wearable Devices for Stress Classification with Explainable AI

Stress has become one of the most prominent problems of modern societies and a key contributor to major health issues. Dealing with stress effectively requires detecting it in real-time, informing the user, and giving instructions on how to manage it. Over the past few years, wearable devices equipped with biosensors that can be utilized for stress detection have become increasingly popular. Since they come with various designs and technologies and acquire biosignals from different body locations, choosing a suitable device for a particular application has become a challenge for researchers and end-users. This study compares seven common wearable biosensors for stress detection applications. This was accomplished by collecting physiological sensor data during Baseline, Stress, Recovery, and Cycling sessions from 32 participants. Machine learning algorithms were used to classify four stress classes, and the results obtained from all wearables were compared. Following this, a state-of-the-art explainable artificial intelligence method was employed to clarify our models’ predictions and investigate the influence different features have on the models’ outputs. Despite the results showing that ECG wearables perform slightly better than the rest of the devices, adding a second biosignal (EDA) improved the results significantly, tipping the balance toward multisensor wearables. Finally, we concluded that although the output results of each model can be affected by various factors, in most cases, there is no significant difference in the accuracy of stress detection by different wearables. However, the decision to select a particular wearable for stress detection applications must be made carefully considering the trade-off between the users’ expectations and preferences and the pros and cons of each device